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DETAILED ACTION 

Response to Amendment 

1 . Applicant's request for reconsideration as discussed in the Interview Summary of 
the 10/24/07 as to the finality of the rejection of the last Office action is persuasive and, 
therefore, the finality of that action is withdrawn 

2. Applicant's arguments with respect to claims 1, 21, 33, 35-52 as filed on 6/7/07 
have been considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC §103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1, 21, 33, 35-52 are rejected under 35 U.S.C. 103(a) as being anticipated 
by Moezzi et al, (hereinafter referred to as "Moezzi") in view of McCutchen. 

Moezzi discloses network-based (Moezzi: column 38, lines 40-50) surveillance 
system (Moezzi: figure 17) for real time monitoring (Moezzi: column 22, lines 55-65) of 
an environment (Moezzi: figure 1), comprising: a first sensor service unit operatively 
coupled to a first immersive sensor for capturing in real time (Moezzi: column 25, lines 
10-20) two or more digital images (Moezzi: column 24, lines 40-55) to generate first 
video data representing a first immersive panoramic field of view of the environment 
(Moezzi: column 23, lines 50-65; column 16, lines 25-35) a sensor subsystem for 
providing real time spherical image data and surveillance data (Moezzi: column 24, lines 
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10-25); and a management console operatively coupled to the network (Moezzi: column 
34, lines 30-55), the network also operatively coupled to the first sensor service unit to 
allow transmission of the first video data from the first sensor service unit to the 
management console (Moezzi: column 23, lines 5-20), the management console including 
a sensor display subsystem for displaying an immersive panoramic video based at least in 
part on the first video data transmitted over the network from the first sensor service unit 
(Moezzi: column 33, lines 5-20); and a data repository operatively coupled to the network 
for storing and retrieving the first video data marked with time-indices (Moezzi: column 
38, lines 30-40), the time indices representing times at which the overlapping digital 
images were captured by the first immersive panoramic sensor (Moezzi: column 29, lines 
20-33), as in claim 1. However, Moezzi fails to disclose a first sensor service unit 
operatively coupled to a first immersive panoramic sensor for capturing in real time 
(Moezzi: column 25, lines 10-20) two or more overlapping digital images (Moezzi: 
column 24, lines 40-55) to generate first video data representing a first immersive 
panoramic field of view of the environment (Moezzi: column 23, lines 50-65; column 16, 
lines 25-35) a sensor subsystem for providing real time spherical image data and 
surveillance data (Moezzi: column 24, lines 10-25), as in the claims. The Examiner notes 
that McCutchen teaches of the use of an first immersive panoramic sensor for capturing 
(McCutchen: figure 19 ) two or more overlapping digital images (Moezzi: column 23, 
lines 5-56) to generate first video data representing a first immersive panoramic field of 
view of the environment (McCutchen: figure 18) a sensor subsystem for providing 
spherical image data and surveillance data (McCutchen: column 1, lines 45-60) in order 
to provide more detail in a monitored view by providing a panoramic image (McCutchen: 
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column 5, lines 30-35). Accordingly, given this teaching, it would have been obvious at 
the time of the invention to augment the Moezzi apparatus by incorporating panoramic 
imaging as from the McCutchen immersive panoramic sensor in order to provide more 
detail in a monitored view by providing a panoramic image at the input. The Moezzi 
apparatus, now incorporating the McCutchen immersive panoramic sensor, has all of the 
features of claim 1 . 

Moezzi discloses a network-based (Moezzi: column 38, lines 40-50) method 
(Moezzi: column 9, lines 45-65) of real time monitoring (Moezzi: column 22, lines 55- 
65) an environment (Moezzi: figure 1), comprising: generating (Moezzi: column 23, lines 
50-65; column 16, lines 25-35), at a first sensor service unit (Moezzi: column 25, lines 
10-20), first video data representing a first immersive panoramic field of view of the 
environment from two or more digital images (Moezzi: column 24, lines 40-55) captured 
by a first sensor (Moezzi: column 38, lines 30-40); and at a the management console, 
displaying a first immersive panoramic video based at least in part on the first video data 
transmitted over the network from the first sensor service unit generating a spherical view 
display using the spherical image data (Moezzi: column 42, lines 30-42); and storing or 
retrieving, at a data repository, the first video transmitted over the network, the first video 
data marked with time indices (Moezzi: column 38, lines 30-40) representing times at 
which the digital images were captured by the first sensor (Moezzi: column 29, lines 20- 
33), as in claim 21. However, Moezzi fails to disclose generating, at a first sensor service 
unit, first video data representing a first immersive panoramic field of view of the 
environment from two or more overlapping digital images captured in real time by a first 
immersive panoramic sensor capturing real-time spherical image data at a sensor 
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subsystem, as in the claim. The Examiner notes that McCutchen teaches of the use of an 
first immersive panoramic sensor for capturing (McCutchen: figure 19 ) two or more 
overlapping digital images (Moezzi: column 23, lines 5-56) to generate first video data 
representing a first immersive panoramic field of view of the environment (McCutchen: 
figure 18) a sensor subsystem for providing spherical image data and surveillance data 
(McCutchen: column 1, lines 45-60) in order to provide more detail in a monitored view 
by providing a panoramic image (McCutchen: column 5, lines 30-35). Accordingly, 
given this teaching, it would have been obvious at the time of the invention to augment 
the Moezzi method by incorporating panoramic imaging as from the McCutchen 
immersive panoramic sensor in order to provide more detail in a monitored view by 
providing a panoramic image at the input. The Moezzi method, now incorporating 
McCutchen's panoramic imaging using the immersive panoramic sensor, has all of the 
features of claim 21. 

Moezzi discloses a computer program product comprising a computer-readable 
storage medium structured to store instructions (Moezzi: column 11, lines 55-67; column 
12, lines 1-26: "software program") executable by a processor in a surveillance system 
(Moezzi: figure 17), the instructions, when executed, cause the processor to perform the 
operations of: at a first sensor service unit (Moezzi: column 25, lines 10-20), generate 
first video data (Moezzi: column 23, lines 50-65; column 16, lines 25-35) representing a 
first immersive panoramic field of view of the environment from two or more 
overlapping digital images (Moezzi: column 24, lines 40-55) captured in real time by a 
first sensor receiving image data and surveillance data from at least one sensor (Moezzi: 
column 38, lines 30-40); and at a management console, display an immersive panoramic 
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video based at least in part on the first video data transmitted over the network from the 
first sensor service unit (Moezzi: column 42, lines 30-42); and at a data repository 
(Moezzi: column 33, lines 5-20), store or retrieve the first video data transmitted over the 
network, the first video data marked with time indices representing times (Moezzi: 
column 38, lines 30-40) at which the overlapping digital images were captured by the 
first immersive panoramic sensor (Moezzi: column 29, lines 20-33), as claim 33. 
However, Moezzi fails to disclose generating, at a first sensor service unit, first video 
data representing a first immersive panoramic field of view of the environment from two 
or more overlapping digital images captured in real time by a first immersive panoramic 
sensor capturing real-time spherical image data at a sensor subsystem, as in the claim. 
The Examiner notes that McCutchen teaches of the use of an first immersive panoramic 
sensor for capturing (McCutchen: figure 19 ) two or more overlapping digital images 
(Moezzi: column 23, lines 5-56) to generate first video data representing a first 
immersive panoramic field of view of the environment (McCutchen: figure 18) a sensor 
subsystem for providing spherical image data and surveillance data (McCutchen: column 
1, lines 45-60) in order to provide more detail in a monitored view by providing a 
panoramic image (McCutchen: column 5, lines 30-35). Accordingly, given this teaching, 
it would have been obvious at the time of the invention to augment the Moezzi method as 
implemented as a computer program product by incorporating the panoramic imaging as 
from the McCutchen immersive panoramic sensor in order to provide more detail in a 
monitored view by providing a panoramic image at the input. The Moezzi method as 
implemented as a computer program product, now incorporating McCutchen' s panoramic 
imaging using the immersive panoramic sensor, has all of the features of claim 33. 
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Regarding claims 35-37, the Moezzi apparatus, now incorporating McCutchen 
immersive panoramic sensor, discloses wherein the first sensor service unit further 
comprises a motion detector for generating a sensor specific motion detection event data 
(Moezzi: column 23, lines 27-42) indicating detection of motion in the two or more 
overlapping images (Moezzi: column 23, lines 27, lines 35-50), the management console 
operatively coupled to the motion detector for generating a motion detection alarm event 
based on the sensor specific motion detection event data (Moezzi: column 42, lines 20- 
62), as in the claims. 

Regarding claims 38-39, the Moezzi apparatus, now incorporating McCutchen 
immersive panoramic sensor, discloses a second sensor service unit operatively coupled to 
a second immersive panoramic sensor for capturing in real time two or more overlapping 
digital images to generate second video data representing a second immersive panoramic 
field of view of the environment, the second sensor service unit operatively coupled to the 
network to transmit the second video data to the management console (McCutchen: figure 
19), as in the claims. 

Regarding claims 40-41, the Moezzi apparatus, now incorporating McCutchen 
immersive panoramic sensor, discloses a second sensor service unit operatively coupled to 
a non-image surveillance sensor system, the non-image surveillance sensor system 
generating non-image event data based on surveillance of the environment but not based 
on overlapping digital images, the management console operatively coupled to the second 
sensor service unit to receive the non-image event data via the network (Moezzi: column 
47, lines 45-67; column 48, lines 1-45), as in the claims. 
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Regarding claims 42-44, the Moezzi apparatus, now incorporating McCutchen 
immersive panoramic sensor, discloses wherein the data repository comprises an image 
store for storing and retrieving the overlapping digital images received from the first 
sensor service unit via the network (Moezzi: figure 17), and a non-image store for storing 
and retrieving the non-image event data received from the second sensor service unit via 
the network (Moezzi: column 42, lines 23-62), as in the claims. 

Regarding claim 45, Moezzi discloses wherein the first sensor service unit 
transmits a heartbeat message to the management console, the heartbeat message 
indicating that the first sensor service unit is enabled and actively communicating with the 
management console via the network (Moezzi: column 29, lines 50-67; column 30, lines 1- 
23), as in the claim. 

Regarding claims 46-48, the Moezzi apparatus, now incorporating McCutchen 
immersive panoramic sensor, discloses at the first sensor service unit, generating a sensor 
specific motion detection event data indicating detection of motion in the two or more 
overlapping images (Moezzi: column 27, lines 35-50); and at the first sensor service unit, 
generating a motion detection alarm event (Moezzi: column 42, lines 20-62), based on the 
sensor specific motion detection event data (Moezzi: column 23, lines 25-35), as in the 
claims. 

Regarding claims 49-50, the Moezzi method, now incorporating McCutchen's 
panoramic imaging using the immersive panoramic sensor, has at a second service unit, 
generating second video data representing a second immersive panoramic field of view of 
the environment from two or more overlapping digital images captured in real time by a 
second immersive panoramic sensor; at the management console, displaying a second 
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immersive panoramic video based at least in part on the second video data transmitted over 
the network from the second sensor service unit; and at the data repository, storing or 
retrieving the second video data (McCutchen: figure 19), as in the claims. 

Regarding claim 51, the Moezzi method, now incorporating McCutchen's 
panoramic imaging using the immersive panoramic sensor, has a at a second service unit, 
generating non-image event data based on surveillance of the environment but not based 
on overlapping digital images (Moezzi: column 47, lines 45-67; column 48, lines 1-45); at 
the management console, receiving the non-image event data via the network; and at the 
data repository, storing or retrieving the non-image event data (Moezzi: column 42, lines 
23-62), as in the claim. 

Regarding claim 52, Moezzi method, now incorporating McCutchen's panoramic 
imaging using the immersive panoramic sensor, has wherein the first sensor service unit 
transmits a heartbeat message to the management console, the heartbeat message 
indicating that the first sensor service unit is enabled and actively communicating with the 
management console via the network (Moezzi: column 29, lines 50-67; column 30, lines 1- 
23), as in the claim. 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Amini discloses a system and method for remote control of 
surveillance devices. Acosta discloses a remote digital image viewing system and 
method. Ritchey discloses a panoramic image based virtual reality/telepresence 
audio/visual system. 
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6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Andy S. Rao whose telephone number is (571)-272-7337. 
The examiner can normally be reached on Monday-Friday 8 hours. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571)-272-7418. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from cither Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO 
Customer Service Representative or access to the automated information system, call 
800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Andy S. Rao 
Primary Examiner 
Art Unit 2621 

asr 

/Andy S. Rao/ 

Primary Examiner, Art Unit 262 1 
September 30, 2008 



